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1 Introduction 

This is a survey note of the author's observations on the discrete-time analogues 
of Ito formulas. The observations are summarized as follows. 

1 . The standard Ito formula is based on the stochastic integrals, while in discrete- 
time frameworks, we instead rely on (conditional) Fourier series expan- 
sions. Detailed explanations will be given in Sectional 

2. In a parallel way that the standard one describes the Kolmogorov equa- 
tion for a given stochastic differential equation, the discrete Ito formula 
gives a finite difference equation for a given approximating equation (Euler- 
Maruyama, for example) of SDE. This observation leads to a computational 
framework of Monte-Carlo simulations of the finite difference scheme for 
partial differential equations in a high dimension. (Section EO) 
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2 Discrete Ito formulas 



2.1 Fujita's Ito formula 

Let us start with Fujita's Discrete Ito Formula (DIF for short) Q for the simple 
random walk; 

Wjfc=Ti+T 2 + ---+Tjfc, (2.1) 

where {ti, ...,t ( , ...} is a Bernoulli sequence such that P(r k = +1) = 1/2. By a 
simple algebra, we have 

{F(+l)-F(-l)} {F (+1) + F(-1)} 
^(t*) = z Tk + 2 

for every F : {-1, +1} — » R. A DIF for / : Z — > R is obtained by regarding 
f(W t+ i) = f(W t + T t ) as a function on {-1, +1} and applying (12.21) to it: 

f(w t+i ) - f(x t ) = f(w t + Tt+1 ) - /to 

/Qy,+ i)-/py,-i) /W + i) + /W-i) 

= ^ T,+l 2 

The starting point is to regard (12.21) as Fourier expansion of F with respect to the 
orthonormal basis { 1, r^}. 



2.2 The first generalization 

Let £ be a real valued random variable with E[£] = and Var[£] = E[£ 2 ] < oo. 
Let v be its law and choose an orthonormal basis {H n : n e N} of the Hilbert space 
L 2 (R, y) by expanding Hq = l,H\(x) = x/ yVar[|]. Then the DIF for the random 
walk (the sum of independent copies of £) 

would be the following orthogonal expansion of f(W tk+l + ■ ) - f(W tk ). 

f(w tk+l ) - f(w tk ) = f(w tk + - /to) 

= (J /TO + *)* v(Jx)J TO +1 - W tk ) 

+ — ^— ( r {/(w ft + ^ - /(w^)} v(^)) (t* + i - **) (23) 

u+i -tk\J I 

;i=2 W / 

Here / is a bounded measurable function. 

When £ is Gaussian, {//„} could be the Hermite polynomials (up to constants). 
Further, if E[£ 2 ] = tk - h-\ , then W can be a Brownian motion. 
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2.3 A multi-dimensional extension 



The DIF for a multi-dimensional random walk W = (W 1 , W"), where Wi - 
Wi = % J k , can be obtained through the expansion in the tensor product (8> 7 L 2 (v 7 ). 
Here the law of f is denoted by vy. Letting v be a trivial measure, we get a DIF 
of(/.W)as 

m + uw tk j-nt k ,w tk ) 

= Z E[^] (f fitM ' W * + Xu + ** - )Xj Vj(dXj) ) (W '^ ~ W *> 
+ - 1 - ( f W ft + x) - f(t k , W tk )} vi ® ■ ■ ■ ® v„(Jx) | - fc) 

+ 



2 ( f W ft + x)Hl( Xl ) • • • Vl (d Xl ) • • • v„(Jx„) 

+-+l„>2 W 



Here / is a bounded measurable function on R' l+1 . 

Now one sees that, in a sense, our DIF gives a discrete and conditioned chaos 
expansion (even when £'s are not Gaussian). The 0-th and the 1st chaoses consist 
of the main terms and the higher order terms correspond to the correction terms, 
when one wants to get the standard Ito formula by letting At := tk+\ - h to 0. 

2.4 DIF for solutions to stochastic difference equations 

Let X be the solution of a stochastic difference equation innovated by W. That is, 
X tk+l = X tk + F(X tk , t k+1 - t k , W tk+l - (2.4) 
for some vector field F : R n x R' l+1 -> R". The DIF for (t, X) would be 

f(t k+ \,X tM ) - f(t k ,X tk ) 

= Z Efi^pj (/ m+u x <* + F(X '- M x)) *> y ^ } ) " 

+ - 1 - ( f {f{t k+ i,X tk + F(X ; „ A ( , x)) - f(t k , X tk )} vi ® ■ • ■ ® v„(Jx) ) - fc) 
- t k \ J ) 



+ 

h 



£ ( f X fi + F(X tt , A?, x))/f;(x!) • • • Hl(x n ) Vl (d Xl ) ■ ■ ■ v n (dx n ) 

+-+l n >2 ^ 



(2.5) 
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When F(x, At, y) is affine in y as 

F(x, At, y) = (r(x)y Va7 + /u(x)At, (2.6) 

where cr : R" — » R" <g> R" and : R" — » R", and when W is a Brownian motion, 
then (12.41) can be seen as an Euler-Maruyama scheme of a stochastic differential 
equation 

dX = o-(X) JW + //(X) <fr. 

Still many classes, including higher order schemes and approximation schemes to 
SDE driven by Levy processes, can be also written in the form of (12.4b . 



2.5 DIF for a class of weak approximation schemes 

For a weak approximation scheme in a Brownian cases, we introduce another 
framework. If we define an ^-dimensional random walk W = (W l , W n ) by 
W{ - W J tk l = VA1, the <|H will work as a weak approximation scheme, 

based on the fact that 



V t k <t 



tk<t 



, t>0 



converges in law to the J-dimensional Wiener process due to the martingale cen- 
tral limit theorem (see, e.g. ® Chapter 7]). 

In this framework, the DIF for (t, X) becomes 

f(t k +\,X tk+l ) - f(t k , X tk ) 



./=! 
+ 



Yj-j=[f f(tk+uX, k + F(X tk , At, H(x)) ) Hj(x) v(dx)j {Wj k+l - W J tk ) 
^1 J {f(t k+ i,X tk +F(X tk ,At,H(x)))-f(t k ,X tk )}v(dx)\ (t k+1 -t k ) 
+ Z(J M™*** +F(X tk ,At,B(x)))H l (x)v(dxyJ H/(4 +I X 



(2.7) 



where we have denoted H(x) = (H\{x), ...,H n (x)). 



2.6 DIF for complete markets 

If jiG = n + 1 in section lTTl then {H , H n } spans the whole space and the correc- 
tion terms in (12.71) disappear. That is, the DIF becomes symbolically equivalent to 
the standard one. This is because the cardinality of the martingale basis of W is 
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equal to the dimension of the state space of itself, as is the case with the standard 
Brownian motions. 

From a perspective of mathematical finance, this property is closely related to 
completeness of the markets modeled by the stochastic process. 

Roughly speaking, a market is said to be complete if every good has a unique 
price that excludes arbitrage opportunities. In many models in financial engineer- 
ing the market is assumed to be complete to avoid discussing too much about the 
utilities/preferences of individuals. 

Discrete-time complete market models are studied in [1J using a DIF. 

2.7 Supplementary remarks for section |U 

We remark that: 

I) This idea, namely conditioned Fourier expansion of the increments can be 
applied to more general cases. It can be "random walks on a graph/group/Polish 
space" , "discrete-time Markov chains on a manifold", or "general semi- 
martingales", etc. 

II) It is also notable that our DIF holds irrespective of the distributions, as far 
as the reference measures are equivalent. 

III) To the best of the author's knowledge, discrete Ito's formula was pioneered 
by T. Szabados |jQ. 

IV) Discrete stochastic calculus, which have more emphasis on chaos expan- 
sions, has been studied by many. A nice exposition [4| on this topic is avail- 
able. 

3 Stochastic Numerics from the Perspective of Dis- 
crete Ito Calculus 

3.1 Reduction to finite difference schemes 

When v is concentrated on a finite set G = {g\, gi}, then 

4(t, x) = E[f(X T )\X t = xl t = to, t u t N , (t N = T, At = l/N) 
solves a finite difference equation 

(<9f + L N )u = with terminal condition u T {T, x) = f(x), (3.1) 
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where 

bfu(t, x) = N{u(t, x) - u(t - l/N, x)} 

and 

L N u(t, x) = N ^{u(t, x + F(x, l/N, Hfe))) - u(t, x)} v( gi ). 

i=\ 

This means that if <9f + L N is consistent 1 with a differential operator d, + L; i.e. 

(df + L N )(p ds —> ^ (d t + L)<p ds as iV — » oo for any smooth <p, (3.2) 
converges to a smooth solution w of (d t + L)m = 0. 

Following standard arguments in the context of the finite difference scheme, 
we illustrate what is going on here. For the solution v 

(df + L N )v = O, v(T) = 0, (3.3) 

we have a discrete Feynman-Kac formula: 

N 

v(t k ,x) = Y j E[®(ti,X tl )\X tk =x\. 

i=k 

Suppose that the smooth solution u exists. Then u - u N is a solution to (13.31) with 
O = {(df + L w ) - (d t + L)}u. Therefore, 

\u N (t,x) - u{t,x)\ < |E[{(3f + L N ) - (d t + L)}u(t u X tl )\X t = x]|, 

and the consistency (13.21) gives the convergence. 

Namely it acts as a finite difference approximation of the partial differential 
equation. Note that the problem of the rate of convergence in the Euler-Maruyama 
scheme: 

E[/(Xf )] ^ E[/(X r )] 

reduces to the same problem in (13.21) . which can be easily calculated in many 
cases. 

3.2 Completeness makes it slow 

As we remarked in section l2~6l the cases where %G = 1 + the dimension of the state 
space is of special interest since it serves as a complete market model. However, 
if one considers them to be a discretization, by the Euler-Maruyama scheme, of a 
continuous-time (complete market) model, one is obliged to pay some costs. 

'See, e.g. |6| 
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Theorem 3.1 (HI). The unique prices of European claims in discrete-time com- 
plete markets converge to the ones in the corresponding continuous complete mar- 
ket as the time-step At tends to 0. The order of convergence is at least VA? and it 
cannot be improved when n > 2. 

Roughly speaking, this is because the set G with %G = n + 1 cannot support 
any n-dimensional random variable which has the same moments up to degree 
three with the increment of ^-dimensional Brownian motion, when n > 2. For 
details, see Q. 

3.3 "Infinite" difference scheme 

The argument in section l3~Tl is still valid for a general v by putting 

L N f(x) = N J f(x + F(x,N- l ,H(y)))v(dy) (3.4) 



for the SDE's in section 1231 

We propose the following implementations. 

1. Let v be the Lebesgue measure on [0, 1]. 

2. Let F be as (12.61) (Euler-Maruyama). 

3. Take the Walsh system as an ONB. Here by the Walsh system we mean the 
group generated by 



t„(x) = 



f+1 if2k <2 n x<2k+l forfc = 0, l,...,2 n ~ X ~ 1, 
1-1 otherwise, 



n = 1, 2, • • • . Note that n, r„, ... are nothing but a Bernoulli sequence. 
We can take, for example, 

H = (Ti,T2,T3,TiT2T3,T4,T 5 ,TiT2T4,TiT 2 T5,TiT2T3T4T5, ....). 

(Just avoid using those with the even-number length.) 

4. Simulate the path X by a Monte-Carlo/Quasi Monte-Carlo uniform sequence 
in [0, l) N . 

This method is meant to be a Monte-Carlo simulation scheme of high-dimensional 
finite difference scheme. It is almost dimension-free. In fact, the dimension n can 
be effectively very large; around 3000, as is reported in Q. 
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3.4 Supplementary remarks for section |3] 

The correspondence of the general Markov chain approximation by (12.41) to finite- 
difference schemes can be generalized to non-linear cases. This generalization 
includes the Kushner's correspondence (see e.g. 0). 
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